ABSTRACT
BACKGROUND: The recent onset of the COVID-19 pandemic and the social distancing requirement have created an increased demand for virtual support programs. Advances in artificial intelligence (AI) may offer novel solutions to management challenges such as the lack of emotional connections within virtual group interventions. Using typed text from online support groups, AI can help identify the potential risk of mental health concerns, alert group facilitator(s), and automatically recommend tailored resources while monitoring patient outcomes. OBJECTIVE: The aim of this mixed methods, single-arm study was to evaluate the feasibility, acceptability, validity, and reliability of an AI-based co-facilitator (AICF) among CancerChatCanada therapists and participants to monitor online support group participants' distress through a real-time analysis of texts posted during the support group sessions. Specifically, AICF (1) generated participant profiles with discussion topic summaries and emotion trajectories for each session, (2) identified participant(s) at risk for increased emotional distress and alerted the therapist for follow-up, and (3) automatically suggested tailored recommendations based on participant needs. Online support group participants consisted of patients with various types of cancer, and the therapists were clinically trained social workers. METHODS: Our study reports on the mixed methods evaluation of AICF, including therapists' opinions as well as quantitative measures. AICF's ability to detect distress was evaluated by the patient's real-time emoji check-in, the Linguistic Inquiry and Word Count software, and the Impact of Event Scale-Revised. RESULTS: Although quantitative results showed only some validity of AICF's ability in detecting distress, the qualitative results showed that AICF was able to detect real-time issues that are amenable to treatment, thus allowing therapists to be more proactive in supporting every group member on an individual basis. However, therapists are concerned about the ethical liability of AICF's distress detection function. CONCLUSIONS: Future works will look into wearable sensors and facial cues by using videoconferencing to overcome the barriers associated with text-based online support groups. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/21453.
ABSTRACT
BACKGROUND: Psychiatric inpatients often have limited access to psychotherapeutic education or skills for managing anxiety, a common transdiagnostic concern in severe and acute mental illness. COVID-19-related restrictions further limited access to therapy groups on inpatient psychiatric units. App-based interventions may improve access, but evidence supporting the feasibility of their use, acceptability, and effectiveness in psychiatric inpatient settings is limited. MindShift CBT is a free app based on cognitive behavioral therapy principles with evidence for alleviating anxiety symptoms in the outpatient setting. OBJECTIVE: We aimed to recruit 24 participants from an acute general psychiatric inpatient ward to a 1-month randomized control study assessing the feasibility and acceptability of providing patients with severe and acute mental illness access to the MindShift CBT app for help with managing anxiety symptoms. METHODS: Recruitment, data collection, analysis, and interpretation were completed collaboratively by clinician and peer researchers. Inpatients were randomized to two conditions: treatment as usual (TAU) versus TAU plus use of the MindShift CBT app over 6 days. We collected demographic and quantitative data on acceptability and usability of the intervention. Symptoms of depression, anxiety, and psychological distress were measured in pre- and poststudy surveys for preliminary signals of efficacy. We conducted individual semistructured interviews with participants in the MindShift CBT app group at the end of their trial period, which were interpreted using a standardized protocol for thematic analysis. RESULTS: Over 4 weeks, 33 inpatients were referred to the study, 24 consented to participate, 20 were randomized, and 11 completed the study. Of the 9 randomized participants who did not complete the study, 7 were withdrawn because they were discharged or transferred prior to study completion, with a similar distribution among both conditions. Among the enrolled patients, 65% (13/20) were admitted for a psychotic disorder and no patient was admitted primarily for an anxiety disorder. The average length of stay was 20 days (SD 4.4; range 3-21) and 35% (7/20) of patients were involuntarily admitted to hospital. Small sample sizes limited accurate interpretation of the efficacy data. Themes emerging from qualitative interviews included acceptability and usability of the app, and patient agency associated with voluntary participation in research while admitted to hospital. CONCLUSIONS: Our study benefitted from collaboration between peer and clinician researchers. Due to rapid patient turnover in the acute inpatient setting, additional flexibility in recruitment and enrollment is needed to determine the efficacy of using app-based psychotherapy on an acute psychiatric ward. Despite the limited sample size, our study suggests that similar interventions may be feasible and acceptable for acutely unwell inpatients. Further study is needed to compare the efficacy of psychotherapeutic apps with existing standards of care in this setting. TRIAL REGISTRATION: ClinicalTrials.gov NCT04841603; https://clinicaltrials.gov/ct2/show/NCT04841603.
ABSTRACT
BACKGROUND: The negative psychosocial impacts of cancer diagnoses and treatments are well documented. Virtual care has become an essential mode of care delivery during the COVID-19 pandemic, and online support groups (OSGs) have been shown to improve accessibility to psychosocial and supportive care. de Souza Institute offers CancerChatCanada, a therapist-led OSG service where sessions are monitored by an artificial intelligence-based co-facilitator (AICF). The AICF is equipped with a recommender system that uses natural language processing to tailor online resources to patients according to their psychosocial needs. OBJECTIVE: We aimed to outline the development protocol and evaluate the AICF on its precision and recall in recommending resources to cancer OSG members. METHODS: Human input informed the design and evaluation of the AICF on its ability to (1) appropriately identify keywords indicating a psychosocial concern and (2) recommend the most appropriate online resource to the OSG member expressing each concern. Three rounds of human evaluation and algorithm improvement were performed iteratively. RESULTS: We evaluated 7190 outputs and achieved a precision of 0.797, a recall of 0.981, and an F1 score of 0.880 by the third round of evaluation. Resources were recommended to 48 patients, and 25 (52%) accessed at least one resource. Of those who accessed the resources, 19 (75%) found them useful. CONCLUSIONS: The preliminary findings suggest that the AICF can help provide tailored support for cancer OSG members with high precision, recall, and satisfaction. The AICF has undergone rigorous human evaluation, and the results provide much-needed evidence, while outlining potential strengths and weaknesses for future applications in supportive care.
ABSTRACT
The World Health Organization characterized COVID-19 (coronavirus disease 2019) as a pandemic on March 11, 2020 (WHO). Within a couple of days, all Canadian provinces announced the implementation of social distancing measures. We evaluated the immediate effect of COVID-19 on psychiatric emergency and inpatient services in Canada's largest psychiatric hospital in the first month of the pandemic. We extracted data from the electronic medical records of the Center for Addiction and Mental Health in Toronto, Canada. We compared emergency department visits, inpatient occupancy rates, and length of stay in March 2019 and March 2020, and during the first and second half of March 2020. There was a decrease in the number of emergency department visits and inpatient occupancy rates in March 2020 compared to March 2019. There was also a significant decrease in the number of emergency department visits and inpatient occupancy rates in the second half of March 2020 compared to the first half. Our findings suggest that the pandemic was followed by a rapid decrease in the usage of psychiatric emergency and inpatient services in a large mental health hospital. Future studies will need to assess whether this decrease will be followed by a return to baseline or an increase in need for these services.